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Abstract. We study Graver test sets for families of linear multi-stage sto- 
chastic integer programs with varying number of scenarios. We show that 
these test sets can be decomposed into finitely many "building blocks", in- 
dependent of the number of scenarios, and we give an effective procedure to 
compute these building blocks. The paper includes an introduction to Nash- 
Williams' theory of better-quasi-orderings, which is used to show termination 
of our algorithm. We also apply this theory to finitcncss results for Hilbert 
functions. 
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Introduction 

A wide range of practical optimization problems can be modeled as (mixed-integer) 
linear programs. While some methods for solving problems like these assume all 
data to be known in advance, others deal with uncertainty. Such uncertainty is 
often inherent to the problem, e. g., demands, prices, or network structure. To be 
able to treat optimization problems of this type, one requires stochastic information 
about the uncertain components. With this knowledge, the problem can then be 
formulated as a stochastic linear program: for example, one that minimizes expected 
costs, or one that minimizes the risk that the costs exceed a given threshold. 

A typical situation is the following: In the first step, one has to make a decision 
x without knowing the outcome of a random event that lies in the future. For ex- 
ample, one needs to decide where to open new production facilities without exactly 
knowing the demand in each geographical area. In a second stage, after observ- 
ing the uncertain data (here: demands), one can make a second (recourse/repair) 
decision y. For example, one may relocate facilities, decide on production or trans- 
portation plans, etc. The goal is now to maximize revenues or profits from these 
facilities. These quantities can be calculated from the immediate costs c T x for 
opening a new location (first stage decision) plus the expected costs and revenues 
Q(x) from relocating and running the facilities (second stage decision). This is a 
typical instance of an expectation problem, which can be modeled as 

min{c T x+ Q(x) : Ax = b, x £ N m }, 

where A £ Z lxm , b £ l) , c £ R"\ and 

Q{x) = E w min {d(uy y : Wy = h(u) -Tx, ye N™} 

where T £ Z lxm , W £ Z lxn , and d, h are random variables taking values in R" 
and Z l , respectively. Note that in the formulation of the problem we assume that 
the outcome of the random event ui does not depend on the first-stage decision x 
that has been made. 

When no integrality constraints are imposed on y, the computation of Q(x) 
involves the symbolic computation of an integral, which is often very hard (even for 
relatively few variables) . In practice, the computation can sometimes be simplified 
by exploiting continuity and convexity of Q(x). However, if y is required to be 
integer, Q(x) is only semi-continuous, and usually not convex. Hence, to make 
computations possible, the probability distribution for w is usually approximated 
by N scenarios oj\,...,ujn with respective probabilities m, . . . , -kn- In this way, 
the integral involved in the computation of Q(x) becomes a sum, and we obtain an 
integer program having a separate set of y- variables corresponding to each scenario: 



min <c T x + ^TTi- (d J yi) : Ax = a, Wy { = h { - Tx, x £ N m , y { £ N ; 




The coefficient matrix of this problem has a nice block structure: 

( A \ 

T W 

\T W ) 
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This two-stage setup (making a decision, observing the outcome of the random 
event, and then making a recourse decision) can be iterated, leading to the notion 
of a multi-stage stochastic integer program. (See |3L)j for a recent survey of this 
topic.) In these programs, information is revealed only at certain points in time, 
and decisions have to be made without knowing the outcome of future random 
events. Again we assume that each random event neither depends on the outcome 
of previous random events nor on the decisions made in the previous stages. The 
integer programs which we obtain by discretizing the probability distributions of the 
random variables involved quickly become very big and hard to solve in practice. 
However, as in the two-stage example above, the non-anticipativity assumption 
leads to highly structured problem matrices. 

In ^21 j Hemmecke and Schultz exploited this structure to construct a novel 
algorithm for the solution of two-stage stochastic integer programs, which is based 
on successive augmentation of a given feasible solution. The main goal of this paper 
is to extend the ideas presented in |12l 15] from two-stage to multi-stage programs. 
Instead of decomposing the problem itself, as essentially all other decomposition 
approaches to two- and multi-stage stochastic integer programming do, we will 
decompose an object that is closely related to the given problem matrix: its Graver 
test set (or Graver basis). The structure of the problem matrix also imposes a lot 
of structure on the elements in the Graver basis: for a given family of (k + 1)- 
stage stochastic integer programs (k G N) we can define a certain (a priori infinite) 
set Ttk,oc of "building blocks," from which all elements in the Graver basis of the 
coefficient matrix can be reconstructed, independent of the number N of scenarios. 
(We refer to Section |H1 for the precise definition.) We will prove that this set of 
building blocks, in fact, is always finite. We also show how to compute 7ik,oo (even 
if only theoretically), and how it can be employed to solve any given particular 
instance of the given family of (k + l)-stage stochastic integer programs. 

It is perhaps remarkable that our proof of the finiteness of Tik.oo rests on some 
non-trivial properties of the set W 1 of n-tuples of natural numbers. Some of those 
have appeared before, under various guises, in computational algebra. The most 
prominent one, known as "Dickson's Lemma," can formulated like this: 

For every infinite sequence X v< ~ ' , X u< * , . . . of monomials in the 
polynomial ring Q[X] = Q[X U . . . , X n ], where X v = X^ 1 ■ ■ ■ X^ 
for v = (i>i, . . . , v n ) S N", there exist indices i < j such that X v< ~ 
divides X v i . 

This simple combinatorial fact alone is at the heart of many finiteness phenomena 
in commutative algebra, since it readily implies Hilbert's Basis Theorem: every 
ideal of the polynomial ring K[X) = K[X±, . . . , X n ], where K is a field, is finitely 
generated. Dickson's Lemma yields that every monomial ideal of K[X] (that is, 
an ideal generated by monomials) is finitely generated (see, e.g., Proposition 13.11 
below), and Gordan's famous proof of the Hilbcrt Basis Theorem extends this to 
all ideals of -K"[X]. Now Dickson's Lemma in turn is a consequence of a somewhat 
more powerful (and less obvious) finiteness statement: 

There is no infinite sequence 1^,1^,... of monomial ideals in 
the polynomial ring Q[X] such that 7" ^ 1^ f or a ^ * < 3 ■ 

This principle can be easily shown using known techniques in the subject of "well- 
quasi-orderings" . Maclagan ^Hj rediscovered this fact (by primary decomposition 
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of monomial ideals) and demonstrated how it can be used to give short proofs of 
several other finiteness statements like the existence of universal Grobner bases and 
the finiteness of the number of atomic fibers of a matrix with non-negative integer 
entries. (Other applications can be found in U2|.) The connections to well- 

quasi-orderings have been made explicit and further explored by the first author 
and Pong in £Q. 

In this paper we exploit an infinite hierarchy of finiteness principles, of which the 
statements above only represent the two bottom levels. For a precise formulation 
we refer to Theorem 15 .91 below. Here, let us just state an attractive consequence of 
the next statement in the hierarchy: 

Theorem. Let S be a collection of monomial ideals in the polynomial ring Q[X], 
and let M\, M2, ■ ■ ■ be an infinite sequence of collections of monomial ideals from 
S, where each Mi is closed under inclusion (if I 6 Mi and J £ S is a monomial 
ideal such that J C I t then J G Mi). Then Mi C Mj for some indices i j . 

(The statement remains true if "closed under inclusion" is replaced by "closed 
under reverse inclusion.") 

We construct this hierarchy using Nash- Williams' beautiful theory of "better- 
quasi-ordered sets" . This theory, although of a fundamentally combinatorial nature, 
is probably less well-known in the field of algorithmic algebra than among logicians, 
who explored its connections to descriptive set theory and computability theory |31j , 
and, more recently, investigated its logical strength [2], [21] • It is for this reason 
that we include an introduction to this subject in Part 1 of the paper ( Sections GHU, 
with the hope that it will become useful as a general guide for proving termination 
of algebraic algorithms. We finish Part 1 by applying Nash- Williams' theory to 
prove a few finiteness properties for Hubert functions (in Section^, some of which 
are known (Corollary 16. 4f> . and some of which might be new (Proposition 16 . 5|) . 

In Part 2 of the paper we then apply the theorems of Part 1 to establish finiteness 
and computability in the decomposition approach to solve multi-stage stochastic 
integer programs mentioned above. We begin by giving a brief introduction to 
Graver test sets for integer linear programs. For a more thorough treatment see, 
e.g., After introducing Hk, 00 in Section|Hl we show that this set is always finite, 
and give an algorithm to compute a set of vectors containing it (in Section EJ). The 
set TLk,oo holds an enormous amount of information. We finish the paper by showing 
how knowledge of (an object related to) TCk, 00 allows one to solve any given instance 
of our family of (k + l)-stage stochastic integer programs, for any given number of 
scenarios. 

Conventions and notations. Throughout this paper, m and n range over the 
set N — {0, 1, 2, . . . } of natural numbers. 

Part 1. Noetherian Orderings and Monomial Ideals 

1. Preliminaries 

We first introduce some notations about sets of natural numbers which are con- 
stantly used throughout Part 1. We then discuss an infinitary version of Ramsey's 
Theorem due to Galvin and Prikry, which is at the base of Nash- Williams' theory, 
together with the notion of a "barrier" . The reader may skip this section at first 
reading and come back to it when it is really needed (in Section EJ. 



FINITENESS THEOREMS IN STOCHASTIC INTEGER PROGRAMMING 



5 



Sets and sequences of natural numbers. For a set X, we denote the power 
set of X (the set of all subsets of X) by V(X). Given X C N and n, we denote by 
[X] n the set of all subsets of X consisting of exactly n elements. We let 

[*]<" := |J [XY\ 

the set of all finite subsets of X. By [X]" we denote the set of all infinite subsets 
of X. (So V(X) = [X] <ul U [X]".) 

For every subset of N, there is a unique sequence enumerating it in strictly 
increasing order; throughout this section, we will identify subsets of N and strictly 
increasing sequences of natural numbers in this way. (The empty set corresponds 
to the empty sequence.) Below, s,t,u range over [N] <w , and U, V, W,X over [N] w . 

We denote by l(s) the cardinality of s. So if s is identified with the corresponding 
strictly increasing sequence, then l(s) is its length. For every ^ i < l(s) we write 
Si for the (i + l)-st element of s; therefore, we can write s as s = (so, . . . , S/( s )-i)j 
with so < s i < • ' ' < s i( s )-i- We write s ^ t if s is an initial segment of t, that 
is, l(s) ^ Z(£) and s, = £j for all ^ i < l(s). We put s -< t if s is a proper initial 
segment of t, i.e., s ■< t and s ^ t. These relations extend in a natural way also to 
the case where t is replaced by an infinite subset of N. Clearly s ^ t implies sCt. 

If l(s) = n ^ 1, then s \ {mins} is the sequence (si, . . . ,s„_i) obtained from 
s = (so, si, . . . , s n _i) by leaving out its first element sq. Similarly if l(s) ^ 1, then 
t \ {maxr} is the sequence obtained from t by leaving out its last element. We 
define, for non-empty s,t: 

s < t s \ {min s} ■< t \ {maxi}. 

Note that the relation -< on [N] <w is irreflexive (s -fi s for all s E [N] <u ) and 
transitive (if s -< i and t ~< u, then s -< u), whereas the relation < on the set [N] <w 
is neither irreflexive nor transitive. 

The Ellentuck topology. We write s < U if max s < min {/. Here and below, 
max0 := — oo < a for all a G N. If s < U, we put 

[s,U] := {l£[sU[/f:s^ X}. 

We endow [N] w with the Ellentuck topology, whose basic open sets are the sets of 
the form [s, U] for s < U as above. (This topology was first introduced in 4 .) For 
X E we consider each [X]^ as a subspace of [N] w , equipped with the induced 
topology. 

A theorem of Galvin and Prikry. If N = P U Q is a partition of N, then one 
of P or Q is infinite, by the familiar (Dirichlct) pigeon-hole principle. Ramsey's 
Theorem is an extension of this principle: if [N] n = P U Q is a partition of 
[N] n , then there is H e [N] w such that [H] n C P or [if]" C Q. (Such a set if is 
called a homogeneous set for the partition [N] n = P U Q-) Later on, we will need 
a far-reaching generalization of this theorem, concerning partitions \N] U = P U Q 
of [N] w . We have to place some restrictions on the nature of the partitioning sets 
P and Q, since the natural analogue of Ramsey's Theorem for partitions of [N] w 
fails for pathological partitions constructed using the Axiom of Choice. (See |15j . 
Section 19.) 
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Theorem 1.1. (Galvin-Prikry 0.) Let X E [N] w , and suppose [X] w = P U Q is a 
partition of [A]" , where P is an open set {in the Ellentuck topology). Then there 
exists H G [X]" such that [H] w C P or [H]" C Q. 

We refer to (TJ|, Section 19 or [3T] for a proof. 

Blocks and barriers. The language of "blocks" and "barriers" will be used in 
the later sections, for the definition of "Nash- Williams orderings." For X E [N] w 
and a e N, we define X >a E [N] w by X >a := {x E X : x > a}. 

Definition 1.2. A subset B of [X] <ul is called a block (with base X) if 
(BO [Xr = \J seB [ S ,A> maxs ], and 
(B 2 ) s -fi t for all s,t E B. 

In other words, a subset B of [A] <w is a block with base X if and only if for 
every strictly increasing infinite sequence (xq, x%, . . . ) of elements of X, there exists 
a unique n such that (xq, x±, . . . , x n ) E B. It follows that every strictly increasing 
sequence over X (finite or infinite) has at most one initial segment which lies in 
B. (Since every element of [X] <w occurs as an initial segment of some element of 
[X]".) Moreover, note that for a block B, its base is given by X = [J{b : b E B}. 

Examples. 

(1) For any n > 0, [X] n is a block with base X. 

(2) Suppose B is a block with base X, and let C C B, Y E [X]". Then C is a 
block with base Y if and only if C = B n [Y] <UJ . 

A block B is called a barrier if instead of (B 2 ) it satisfies the stronger condition 
(B 2 ) s qt t for all s,t E B. 

The statements in the examples above remain true if "block" is replaced by "bar- 
rier". Theorem 1 1 . 1 1 has the following important consequence: 

Corollary 1.3. If B is a block with base X and B — B\ UB2, then there is a block 
B'CJJ such that B' C B 1 or B' C B 2 . 

Proof. We may assume that B\ and B2 are disjoint, so 

P= [j [s,X >maxs ], Q= [J [s,A >maxs ] 
seBi seB 2 

give a partition of [X] u into clopen sets P and Q- Hence by Theorem 11.11 there 
exists H E [Xf with [H] u C P or C Q, and it follows that Si n [H] <ul or 

i3 2 n [H] <u) , respectively, is a block. □ 

Since any block contained in a barrier is itself a barrier, the corollary remains 
true with "block" replaced by "barrier." 

Construction of barriers. The following construction turns out to be very useful: 

Proposition 1.4. If B is a barrier with base X E [N]^ ; then so is 

B{2) := {6(1) U 6(2) : 6(1), 6(2) G B, 6(1) < 6(2)}. 

For every b E B(2) there exist unique 6(1), 6(2) G B such that b = 6(1) U 6(2) and 
6(1) < 6(2). 

In the proof, we need: 
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Lemma 1.5. For every Y £ [X]^ and 6(1) £ B with 6(1) < Y there exists 6(2) £ B 
such that 6(1) < 6(2) and 6(1) U 6(2) < Y. 

Proof. The infinite sequence Y \ {minY} £ [X]" has an initial segment 6(2) in B, 
by (Bi). By (B 2 ), 6(2) ^ 6(1), and therefore 6(1) < 6(2). □ 

Proof (of Proposition II. 4JI . Let Y £ [X] u , and let 6(1) be an initial segment of Y 
in B. By the lemma, there exists 6(2) £ B with 6(1) < 6(2) and 6(1) U 6(2) ^ 
Y. Thus B(2) satisfies (Bi). Now let 6(1), 6(2), c(l), c(2) £ B, with 6(1) < 6(2), 
c(l) < c(2), and suppose that 6 C c, where 6 = 6(1) U 6(2), c = c(l) U c(2). Then 
6(2) = 6\ {min6} C c\ {mine} = c(2), hence 6(2) = c(2), by (B 2 ). It follows that 
6 = c and c(l) = 6(1). This shows that -B(2) is a barrier, and also implies the last 
statement. □ 

Corollary 1.6. Let B be a barrier with base X . 

(1) Ifb,c£ B(2), then b < c if and only if 6(2) = c(l). 

(2) If C C B(2) is a barrier with base Y C X, then 

C* := (c(l),c(2) : c£ C} C £ 

is a barrier with base Y £ X. If c\, c>i £ C* satisfy c\ < C2, i/ien i/iere 
exists a unique c £ C such that C\ = c(l) and c 2 = c(2). 

Proof. Part (1) follows from (B2) and the fact that 6(2) = 6 \ {min6} and c(l) ^ 
c \ {maxc}. For part (2), suppose C C S(2) is a barrier with base Y C X, so C — 
5(2) n [Y] <aj . Let 6(1) eBfl [Y] <a \ By Lemma Ol there exists 6(2) £ B n [Y] <w 
with 6(1) < 6(2). Hence 6 = 6(1)U6(2) is an element of B(2)n[Y] <w = C, and thus 
6(1), 6(2) G C*. This shows that C* = B n [Y] <w , that is, C* is a barrier. Finally, 
if ci < C2 are elements of C* , let c = ci U C2 G .6(2); then c(l) = c\, c(2) = C2 as 
required. □ 

2. Orderings 

We state some definitions and facts concerning (partially) ordered sets and maps 
between them, and give our key examples. 

Ordered sets. A quasi-ordering on a set S is a binary relation ^ on S which 
is reflexive and transitive; in this case, we call (S, ^) a quasi-ordered set. (If no 
confusion is possible, we will omit ^ from the notation, and just call S a quasi- 
ordered set.) If in addition the relation ^ is anti-symmetric, then ^ is called an 
ordering on the set S, and (S, ^) (or S) is called an ordered set. If moreover 
x ^ y or y ^ x for all x,y £ S, then ^ is called a total ordering on S. We write 
as usual x < y if x ^ y and y ^ x. 

Maps between ordered sets. A function ip: S — > T between quasi-ordered sets 
(5, ^5) and (T, ^ T ) is called increasing if 

i^s!/^ tp(x) «St <p(y), for all x,y £ S, 
and strictly increasing if 

x < s y => ip(x) < T <p(y), for all x,y £ S. 

Given a quasi-ordering ^ on a set S, there exists a unique ordering on the set 
S/^ = {a/^ : a £ S} of equivalence classes of the equivalence relation 

x ~ y <==^- x ^ y and y ^ x 
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on S such that the surjective map a ^ a/~: S — > is increasing. Hence there 
is usually no loss in generality when working with orderings rather than quasi- 
orderings. In the following, we shall therefore concentrate on ordered sets, and 
mostly leave it to the reader to adapt the definitions and results to the quasi- 
ordered case. 

Quasi-embeddings, embeddings, and isomorphisms. A quasi-embedding 

between ordered sets (S,^g) and (T, < T ) is a map <p: S — > T such that 

ip(x) s^ T ip(y) =>• x s^ s V, for all x,y G S, 

and if in addition ip is increasing, then ip is called an embedding. Any quasi- 
embedding between ordered sets is injective, and any embedding is strictly increas- 
ing. A surjective embedding S — > T is an isomorphism of the ordered sets (S, ^5) 
and (T, < T ). We say that an ordering ^5 on S extends the ordering ^5 if the 
identity on S is an increasing map between (S, ^5) and (S, ^5), that is, if < s C < s 
(as subsets of SxS). We write (S, <s) C (T, ^x) if S* C T and the natural inclusion 
S — > T is an embedding (i.e., ^5 is the restriction of to S). 

Examples 2.1. Here are some methods for constructing new ordered sets from old 
ones. 

(1) Any subset of an ordered set (S, ^) can be naturally made into an ordered 
set by restricting the ordering < to this subset. 

(2) The disjoint union S H T of ordered sets (5, ^s) and (T, ^t) can be natu- 
rally made into an ordered set via the relation ^5 U ^t- 

(3) The cartesian product S x T of ordered sets (5, <s) and (T, ^t) can be 
naturally made into an ordered set by the product ordering 

{x,y) <sxt (x',y') ■■<=> x ^ s x' A y < T y' ■ 

(4) Let (5, ^) be an ordered set. The free commutative monoid generated 
by S is naturally ordered as follows: s\ ■ ■ ■ s m ti ■ ■ ■ t n there exists 
an injective map ip : {1, . . . , m} — > {1, . . . , n) such that s, t<p(i) f° r a ^ 
i = 1, . . . , m. 

Key examples. Two examples will play an important role in further sections. 
The first one is the set N n of n-tuples of natural numbers, ordered by the product 
ordering. It is sometimes convenient to identify the elements of N™ with monomials 
in a polynomial ring as follows: Let X — {X\, . . . , X n } be a set of distinct indeter- 
minates and X° = {X v : v G N™} be the free commutative monoid generated by 
X, where X v := X{ x ■ ■ ■ for v = {u u . . . , v n ) G N". Order X" by divisibility: 

X v ^ X" :<^ /x = 1/ + A for some A G W. 

That is, in the context of example (4) above (for S = X), the ordering on X° 
is ^° where ^ is the trivial ordering on X. The map v 1— ► X v : N" — ► A° is an 
isomorphism of ordered sets. The elements of X° can be seen as the monomials in 
the polynomial ring R[X] = R[Xi, . . . , X n ] over an arbitrary commutative ring R. 

Our second example is the ordering C on the set Z™ of n-tuples of integers defined 
as follows: if a = (a\, . . . , a n ) and b — (61, ... , b n ) are elements of Z™, we put a □ 6 
if Ojfej > and |aj| < |bj| for all j = 1, . . . ,n. That is, a C 6 if and only if a 
belongs to the same orthant of R™ as b, and each of its components is not greater 
in absolute value than the corresponding component of b. Note that C extends the 
product ordering on N™ C Z n . Moreover, we have C a for all a G Z™, and if 
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aCii, then —a C —6, for all a, 6 G Z". The ordered set (Z n , C) can be identified 
in a natural way with the n-fold cartesian product of (Z, C) with itself. We have 
(Z^ , ^) C (Z, C) and {I? , C (Z, C), where (Z^ ) denotes the set of non- 
positive integers (non- negative integers, respectively). This somewhat roundabout 
way of describing (Z™, □) will come in handy in the proof of Corollary 15. 101 

Initial and final segments. An initial segment of an ordered set (5*, ^) is a 
subset / CS such that 

x^yhy&I^x&I, for all x,y G S. 

Dually F C S is called a final segment if S\F is an initial segment. Given an 
arbitrary subset X of S, we denote by 

(X) :={yeS:3xeX(x^y)} 

the final segment of S generated by X, and by 

[X] :={yeS:3xe X(x ^ y)} 

the initial segment generated by X. The set T(S) of initial segments of S is naturally 
ordered by inclusion. Dually, we construe the set ^(S) of final segments of S as 
an ordered set, with the ordering given by reverse inclusion. The intersection and 
union of an arbitrary family of initial (final) segments of S is an initial (resp., final) 
segment of 5. 

Example. The isomorphism v i— > X v identifies W 1 and the monoid of monomials 
in the polynomial ring The ordered set LF(N n ), 2) of final segments of N" 

may be identified with the set of monomial ideals of R[X] (that is, ideals of R[X] 
which are generated by monomials), ordered by reverse inclusion. 

Given a quasi-ordered set (S, ^), we can define a quasi-ordering ^-p(s) on the 
power set V{S) of S as follows: for X,Y e V{S), 

(2.1) X ^-p(s) Y <^=^- for every y £Y there exists x G X such that x ^ y. 

The map F i— > F/^: T(S) — > V(S)/^ is an isomorphism of ordered sets. Here ~ 
is the equivalence relation on V(S) associated to ^-p(S) as m the beginning of this 
section. 

Pullback of final segments. For any function <p: S — > T between ordered sets 
(S, ^s) an d (T, ^ T ), we get an induced increasing function 

between the ordered sets (T(T), D) and (^ r (5 < ), 3). 

Example. Let (S,^g), (T, ^ T ), and (U,^u) be ordered sets, and suppose that 
(S, ^g), (T, ^t) C ([/, ^y), so the natural inclusions i$: S U and ix'- T ^> U 
are increasing. Then 

i*(F)=Fn£?, i* T {F) = FC\T for any F 6 T{U). 

Hence if in addition [/ = 5 U T, then i* s x gives an embedding !F{U) — > ^"(S") x 
F(T). 

The following rules will be used later: 

Lemma 2.2. Let cp: S -> T. 

(1) If ip is a quasi- embedding, then ip* is surjective. 
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(2) // ip is increasing and surjective, then tp* is a quasi- embedding. 

Proof. Since part (2) is clear, we just prove (1). Suppose ip is a quasi-embedding, 
and let G G J~(S). Let F be the final segment of T generated by <p(G). Then 
clearly G C p^ 1 (F). Conversely, if x G S satisfies ip(x) G F, then ip(x) ^ <f(g) for 
some g G G. Since ip is a quasi-embedding, we have x g, so x G G. This shows 
p*(F) = G. " □ 

Antichains. For elements x,y of an ordered set S, we write x\\y ii x ^ y and 
y ^ x. An antichain of 5 is a subset ACS such that x||y for all x 7^ y in A. An 
element x of 5 is called a minimal element of5'ifj/^x=>j/ = x for all y G 5. 
The minimal elements of a subset ICS form an antichain, denoted by -Xmin- 

Well-founded orderings. An ordered set S is well-founded if there is no infinite 
strictly decreasing sequence xq > x\ > ■ ■ • in S. For any element x of a subset X of 
a well-founded ordered set S, there is at least one minimal element y G A m in with 
y ^ x. It follows that any final segment F of S is generated by its antichain F m i n 
of minimal elements; in fact, F min is the (unique) smallest generating set for F. 

3. NOETHERIAN ORDERINGS 

We say that an ordered set S is Noetherian if it is well-founded and every antichain 
of S is finite. More generally, we say that a quasi-ordered set S is Noetherian if 
the associated ordered set S/~ is Noetherian. Since every antichain of a totally 
ordered set consists of at most one element, a totally ordered set S is Noetherian 
if and only if it is well-founded; in this case S is called well-ordered. 

Remark. Noetherian orderings are usually called "well-quasi-orderings" in the lit- 
erature (see, e.g., 53). Following a proposal by Joris van der Hoeven ^1] we use 
the more concise term "Noetherian" . 

An infinite sequence Xo, x\, . . . in S is good if x, ^5 Xj for some i < j, and bad, 
otherwise. Clearly, if {xo, X\, . . . } is an antichain, then xq, xi, . . . is a bad sequence. 
The following characterization of Noetherian orderings is folklore (see, e.g., |22p. 

Proposition 3.1. Let S be an ordered set. The following are equivalent: 

(1) S is Noetherian. 

(2) Every infinite sequence xq, x±, . . . in S contains an increasing subsequence. 

(3) Every infinite sequence Xo,Xi, . . . in S is good. 

(4) Any subset ICS has only finitely many minimal elements, and for every 
x G X there is a minimal element y of X with x y. 

(5) Any final segment of S is finitely generated. 

(6) (J-(S),^ is well-founded (i.e., the ascending chain condition with respect 
to inclusion holds for final segments of S). 

(7) (I(S), C) is well-founded (i.e., the descending chain condition with respect 
to inclusion holds for initial segments of S). 

Proof. The implication (1) (2) follows from applying Ramsey's Theorem to the 
partition [N] 2 = P U Q U R, where 

P = {{hj} : x l \\x ] ), Q = {{i,j} :i<j,Xi> x 3 }, 

and R = [N] 2 \ (P U Q). The implications (2) =*> (3) =*> (1) are trivial, and 
(1) => (4) (5) follows from the remarks at the end of the last section. If 
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Fo C Ft C • • • is an ascending chain of final segments of S, then i 7 = (J n i 7 ^ 
is a final segment of S". If F is finitely generated, say by X C F, then ICF„ for 
some n; thus _F„ = J^n+i = • ■ ■ . This shows (5) => (6); by passing to complements, 
we obtain (6) <^=> (7). For (6) (3), let xo,xi, . . . be a sequence in S. By (6), 
the sequence (xo) C (xo,xi) C ■ • ■ of final segments of S becomes stationary: for 
some n, we have Xj S (xq, ...,%) for all j > n. In particular, Xj 5j x„+i for some 
ie{0,...,n}. □ 

The proposition now immediately provides the following construction methods 
for Noetherian orderings: 

Examples. Suppose (>S, ^g) and (T, are ordered sets. Then: 

(1) If there exists an increasing surjection S — ► T, and (5, ^5) is Noetherian, 
then (T,^ T ) is Noetherian. In particular, if (5, ^s) is Noetherian, then 
any ordering on S which extends ^5 is Noetherian. 

(2) If there exists a quasi-embedding S — > T, and (T, is Noetherian, then 
(S, ^5) is Noetherian. In particular, if (T, is Noetherian, then any 
subset of T with the induced ordering is Noetherian. 

(3) If (5, <s) an d (T", are Noetherian and (U, ^u) is an ordered set with 
(S, (T, s^ T ) C (Z7, <tr), then 5 U T is Noetherian. In particular, it 
follows that 5 II T is Noetherian. 

(4) If (S,^ s ) and (T, < T ) are Noetherian, then so is 5 x T. Inductively, it 
follows that if the ordered set (S, ^5) is Noetherian, then so is S n equipped 
with the product ordering, for every n > 0. 

Applying Example (4) to S = N, we obtain: 

Corollary 3.2. (Dickson's Lemma.) For each n > 0, the ordered set N™ is Noe- 
therian. □ 

By combining Examples (3) and (4) with the analysis of the ordered set (Z n , C) 
given in the last section, we get: 

Corollary 3.3. For each n > 0, the ordered set (Z™, C) is Noetherian. □ 
4. Strongly Noetherian Orderings 

Besides the results stated in the examples following Proposition 13. II several other 
preservation theorems for Noetherian orderings are known. For example, if (S, $C) 
is a Noetherian ordered set, then so is (S°, as defined in Section|2] (This was 
first proved by Higman |13| . with a simplified proof given by Nash- Williams |24|.') 
Similar theorems can be proved for other ordered sets built from S, for example the 
collection of all finite trees whose nodes are labelled by elements of S, ordered by 
the homeomorphic embedding ordering (Kruskal The common feature of all 

these constructions is their finitary character. If one builds ordered sets by allowing 
operations of an infinite nature, the situation changes drastically: for example, if 
S is a Noetherian ordered set, then [!F(S),^) is in general not Noetherian. An 
example for this phenomenon was first given by Rado [2E] : Let R := [N] 2 , ordered 
by the rule 

(hj) (k, I) either i = k and j ^ I, or j < k. 

It is quickly verified (see, e.g., ^H|) that (R, ^_r) is a Noetherian ordered set, but 
2) is not Noetherian: the sequence F\,F%,... where Fj is the final segment 
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of R generated by all € N 2 with i < j, is an infinite antichain in J-(R). This 
example is archetypical in the following sense: 

Theorem 4.1. For a Noetherian ordered set (S, ^s), the following are equivalent: 

(1) (^(S), 2) is not Noetherian. 

(2) (X(S'), CJ is not Noetherian. 

(3) There exists a function f : [N] 2 — » S such that f(i,j) f(j,k) for all 
i < j < k. 

(4) There exists an embedding [R, ^.r) — * (S, ^s). 

(5) There exists a quasi- embedding (R, ^.r) — > (S, ^s). 

Proof. The implication (1) =>■ (2) is trivial. Suppose Iq,Ii,... is a bad sequence in 
(l(S), CJ, So for each i < j there exists a € U with a ^ b for all 6 6 Ij. Hence it is 
possible to choose, for each i < j, an element f(i,j) € Ii such that for all i < j < k, 
we have f(i,j) £ s f{j,k). This shows (2) (3). For (3) =► (4), let /: [N] 2 -> S, 
f(i,j) = flij, be as in (3). Consider the partitions 

[N] 3 = PUQ, [N] 4 = P'uQ' 

given by 

P = {{i,j, k}:i<j <k, aiJ ^a lk ), Q = [N] 3 \ P 

and 

P' = {{i,j, k,l}:i<j <k<l, a 4j < a kl ), Q' = [N] 4 \ P' . 
By applying Ramsey's Theorem twice we obtain an infinite set H C N which is 
homogeneous for both partitions. Since S is Noetherian, we must have [H] 3 C P, 
[H] 4 CP'. It follows that 

{i,j) <Ji(fe,0 <<=^ <kj <s am, 
for all i<j,k<l in H. Therefore, {ay : i < j, z,j £ if} (with the ordering 
induced from S 1 ) is isomorphic to (R,^r). The implication (4) => (5) is again 
trivial, and (5) =>■ (1) follows from Lemma 12.21 (1) and Example (1) following 
ProDOsition l3.ll □ 

Let us call an ordered set (S, ^s) strongly Noetherian if (!F(S),Z}^ is Noe- 
therian. (So a forteriori, (S, ^s) is Noetherian, by Proposition ^. II ) The following 
facts follow easily from Lemma T2. 21 and the examples after Proposition ^. II 

Examples. Suppose (5*, ^g) and (T, are ordered sets. Then: 

(1) If there exists an increasing surjection S — ► T and (S, ^5) is strongly Noe- 
therian, then (T, ^y) is strongly Noetherian. In particular, if (S, ^5) is 
strongly Noetherian, then any ordering on S which extends ^5 is strongly 
Noetherian. 

(2) If there exists a quasi-embedding S — > T and (T, sC T ) is strongly Noe- 
therian, then (S,^s) is strongly Noetherian. In particular, if (S 1 , ^5) is 
strongly Noetherian, then any subset of S with the induced ordering is 
strongly Noetherian. 

(3) If (S, ^5) and (T, s^y) are strongly Noetherian and (U, ^u) is an ordered 
set with (5", (T, < T ) C (U, <£/), then 5 U T is strongly Noetherian. In 
particular, it follows that if (S, ^5) and (T, are strongly Noetherian, 
then so is S II T. 

Strong Noetherianity is also preserved under cartesian products: 
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Proposition 4.2. If(S, ^5) and (T, are strongly Noetherian ordered sets, then 
S x T is strongly Noetherian. 

(This fact was stated without proof in 13] and attributed there to Farley and 
Schmidt. For another proof see pQ.) 

Proof. Let / : [N] 2 -> 5 x T. We denote by tt s : 5 x T -> 5 the projection (s, t) i-> s 
onto the first component, and we put fs '■= ^s°f- Similarly we define fx ■ [N] 2 — > T. 
Since 5 is strongly Noetherian, there are i < j < k with fs(i,j) fs(j, k). (By 
the previous theorem.) Now Consider the partition [N] 3 = P U Q, where 

P={{i,j,k}:i<j <k, f s (i,j)<s fs(j,k)}, Q = [N] 3 \P. 

By Ramsey's Theorem, we find an infinite homogeneous set H C N for this par- 
tition. Since S is strongly Noetherian, we must have [H] 3 C P. Changing from 
N to H, we thus may assume that fs{hj) fs(j,k) for all i < j < k. Since 
T is strongly Noetherian, there are i < j < k with frihj) frij^k). Hence 
fihj) < fU, k). Thus SxTis strongly Noetherian. □ 

Corollary 4.3. (Maclagan, |18j.) The ordered set N n is strongly Noetherian, for 
every n > 0. □ 

5. Nash- Williams Orderings 

By the equivalence of (1) and (3) in Theorem 14. II strong Noetherianity may be ex- 
pressed using the terminology introduced in Section^ An ordered set S is strongly 
Noetherian if and only if for every function f : B —> S , where B C [N] 2 is a bar- 
rier, there exist 61,62 S B with b\ < 62 and /(&i) ^ f{°2)- The search for a 
combinatorial condition on an ordered set S which ensures that (T(S), 2) is not 
only Noetherian, but strongly Noetherian, therefore naturally leads to the following 
concept introduced by Nash- Williams [2H] (under the name of "better well-quasi- 
ordering"). Below, we shall call a function / : S — > 5, whose domain B C [N] <w is 
a barrier, an S*-array. (So in particular, every sequence xq,x%, . . . of elements of 
S can be considered as an i'-array.) We say that an S'-array /: B — > S is good if 
there are 61, 62 £ B such that 61 < 6 2 and /(61) < fipi)-, bad if it is not good, and 
perfect if /(61) ^ /(fo) for all b\ < 6 2 in B. 

Definition 5.1. An ordered set S is Nash- Williams if every S'-array is good. A 
quasi-ordered set S is Nash- Williams if <S/~ is a Nash- Williams ordered set. 

Clearly if S is Nash- Williams, then S is Noetherian. Moreover: 

Lemma 5.2. J/S 1 is well-ordered, then S is Nash- Williams. 

Proof. Suppose / : B — > S is an S'-array. Let 61 £ B be such that = min f(B). 

By Lemma H~51 there exists 62 S -B such that 61 < 62, and we have /(61) ^ f(p2)- O 

As we did for strong Noetherianity, we will now successively show that each of 
the constructions exhibited in the examples following Proposition lH . II preserves the 
Nash- Williams property as well. 

Lemma 5.3. Let (S, ^5) and (T, sjy) be ordered sets. 

(1) If there exists an increasing surjection S — > T and S is Nash- Williams, 
then T is Nash- Williams. 
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(2) If there exists a quasi- embedding S — > T and T is Nash- Williams, then S 
is Nash- Williams. 

Proof. Let ip: S T. For part (1), suppose (p is increasing and surjective, and let 
/: B — > T be a T-array. Choose any function ip: T — > S such that ip o ip = idr- 
Then ip o / : B — > 5 is an S-array. Since S is Nash- Williams, there exist 6i, 62 £ -B 
with 61 <a 62 and ip(f{b\)) <s ipiffa)), hence /(fo)- For part (2), assume 

that cp is a quasi-embedding, and let g : -B — > S be an S'-array. Then <p o g; B — > T 
is a T-array. Since T is Nash- Williams, there exist b\ , 62 € -B with 61 < 62 and 
(^(g(6i)) ^(5(^2))) hence 3(61) 5(62)5 since is a quasi-embedding. □ 

In particular, if (S, ^) is a Nash- Williams ordered set, then so is any subset of 
S with the induced ordering, and any ordering on S which extends the ordering $J 
on S. 

Lemma 5.4. Suppose that (S,^s)> (^\^t) an d (U,^u) ar & ordered sets, with 
(S, ^s), (T, ^5) C (U,^u)- If S and T are Nash- Williams, then S U T is also 
Nash- Williams. 

Proof. Let /: B -> 5 U T be a bad 5 U T-array. Let B s := /^(S) and B T := 
/ _1 (T). Then there exists a barrier B' <Z B such that £' C Tig or B' C 5 T , 
by Corollary 11.31 So either f\B' is a bad S'-array, or f\B' is a bad T-array, a 
contradiction. □ 

It follows that if (S, sC s ) and (T, s^ T ) are Nash- Williams, then S II T is Nash- 
Williams. Every finite ordered set is Nash- Williams. 

The following fact distinguishes Nash- Williams orderings (among Noetherian, or 
strongly Noetherian, orderings). 

Proposition 5.5. Suppose that the ordered set S is Nash-Williams. Then the 
ordered sets (.F(S),3j and (Z(S),c) are Nash- Williams. 

Proof. Let / : B — > T(S) be a bad T(S)-array. By Proposition ! 1.41 B(2) is a barrier. 
We construct a bad S-array g: B(2) — > S as follows: For every fee B(2), we have 

/(&(!)) 2 /(K 2 )); so we can choose 50) e /(H 1 )) \ /0( 2 ))- Now suppose c e B(2) 
with b < c. Then c(l) = 6(2) (by Corollarv ll.6l (1)), hence 5(6) ^ g(c). Therefore, g 
is bad. This shows that Z(S) is Nash- Williams. Suppose h: C — > ^(S) is an J-(S)- 
array. We then consider the X(S)-array h' : C T(S) defined by /i'(c) — S \ h(c), 
for all c 6 C. Since Z(S) is Nash- Williams, we find ci < C2 in C with h'(ci) C h'(c.2), 
and hence /i(ci) 3 M c 2)- Thus /i is good, and .F(S) is Nash- Williams. □ 

For the definition of the quasi-ordering ^-p(s) in the statement of the next corol- 
lary, see Q2.1JI . 

Corollary 5.6. If S is a Nash-Williams quasi-ordered set, then the quasi-ordered 
set rP(S'), ^-p(s)) *s Nash- Williams. 

Proof. The canonical increasing surjection (/? : S — > S/~ induces an isomorphism 
</?* : JF(S/^) — > J-(S). By the proposition, ,F(S/~), and hence J-(S), is Nash- 
Williams. Since P(£)/~ = ^(S), it follows that P(S) is Nash- Williams. □ 

Next, we want to show that the cartesian product of any two Nash- Williams or- 
dered sets is again Nash- Williams. The proof is similar to the one of Proposition ^. 21 
and uses the following lemma. Here, an S-subarray of an S-array / : B — > S is an 
S-array g: C S where CCB,g = f\C. 
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Lemma 5.7. Let (5,^) be an ordered set. Every S-array contains either a bad 
S-subarray or a perfect S-subarray. 

Proof. Let /: B — > S be an S-array. Consider the partition B(2) = P U Q of the 
barrier B(2), where 

P = {6€fl(2):/(6(l))</(6(2))}, Q = B(2)\P. 

By Corollary Ol there is a barrier C C 5(2) such that C C P or C C Q. By 
Corollarv ll.61 (2), C* CBisa barrier, and /|C* is either perfect or bad, depending 
on whether C C P or C C Q. □ 

Proposition 5.8. If (S,^g) and (T, are Nash- Williams ordered sets, then 
S xT is Nash-Williams. (_25 , Corollary 22A.) 

Proof. Let f : B ^ S x T be a,n S x T-array; we want to show that / is good. By 
the previous lemma, and since S is Nash- Williams, the 5-array f$ = tts ° / has a 
perfect S-subarray B' — > S 1 . Restricting / to the barrier B' , if necessary, we may 
assume that f$: B — > 5 is perfect. Since T is Nash- Williams, there exist 6i, 62 £B 
with 61 < 6 2 and /r(£>i) frikz), whence /(61) ^ /(^)- So / is good. □ 

It follows that N n is Nash- Williams, for any n > 0. Defining inductively 

^o(N n ) := N n , ^+i(N n ) := f{f k (N n )) for all k e N, 

we get, by Proposition l5.5l 

Theorem 5.9. .Eac/i 0/ i/ie sets 

J"i(N n ) = J"(N n ), J" 2 (N n ) =^(^ 1 (N")), 

ordered by reverse inclusion, is Noetherian. □ 

Remark. Theorem 15.91 above implies that every subset of .F(N n ) is strongly Noe- 
therian, and hence yields the theorem in the introduction. 

Lemma 15.41 and Proposition 15.81 show that (Z n ,C) is Nash- Williams, for any 
n > 0. As above, this implies that each set 

F(Z n ,Q, T(T(% n ,Q), .... 

ordered by reverse inclusion, is Noetherian. Here is a slight reformulation of this fact 
which will be used in Part 2. Let C denote the ordering C on Po(Z n ) := Z™, and 
inductively define Pfc + i(Z") := P(P fe (Z ra )) and a quasi-ordering of P fe+ i(Z 71 ) 

as follows: for X, Y G P k+1 {T l ) put 

(5.1) X Qk+i Y •<=/■ for each y G y there is some a; G X with a; C/. y. 

(That is, ^k+i = ^v(v k (z n ),[z k ) for all k, in the notation of |2.1jl .) By induction 
on k, Corollary 15 . 61 implies: 

Corollary 5.10. The quasi-ordered set rPfc(Z™), C fe ) is Noetherian, for each k G N 
and n > 0. □ 
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6. Applications to Hilbert Functions 

As an illustration, let us show how Nash- Williams' theory as outlined above can 
be employed to deduce some finiteness properties for Hilbert functions. We work 
in a rather general setting. Let (S, ^) be a non-empty ordered set and 5: S — > A a 
map, where A is any set. We think of 5 as providing a grading of S by A, and we 
call S(s) £ A the degree of s £ S. We call a final segment F of S admissible if 
for any degree a G A, there are only finitely many x (fc F with S(x) = s. If the map 
5 has finite fibers, then every final segment of S is admissible. (This is the case, 
for example, if S is Noetherian and 5 : S — > A is a strictly increasing map into an 
ordered set A, see Example (1) following Proposition 13. Il l 

We extend the ordering of N to a total ordering of the set Noo = N U {oo} by 
declaring n < oo for all n £ N. For a final segment F of S and a degree a £ A, 
we let hpia) be the number of elements of S of degree a which are not in F (an 
element of Noo). We shall call h F : A -> the Hilbert function of F G F{S). 
(So F is admissible precisely if hp(a) G N for all a.) 

Growth of Hilbert functions. First we show that the growth of Hilbert functions 
is finitely determined in the following sense. We fix an ordered set S and a grading 
5 of S by A as above. 

Proposition 6.1. Suppose S is strongly Noetherian, that is, !F(S) is Noetherian, 
and let h: A — > be any function. There exist finite sets M^h, M-^h and Ai^h 
of final segments of S such that for every final segment F of S , we have 

/ii?(a) ^ h(a) for all a <==^ F C E for some E G M^h, 

hF{o) > h(a) for some a <^=> F C E for some E G M^h, 

and 

hp{a) ^ h(a) for all but finitely many a F C E for some E G M)~h- 

Proof. For a £ A, consider the subsets 

T a := {F £ ?{S) : h F (a) > h(a)}, T' a := {F £ ?{S) : h F {a) > h(a)} 

of T(S). Since for all E, F £ T{S), 

E D F => h E {a) ^ h F (a) for all a £ A, 

T a and T' a are final segments of the Noetherian ordered set {T[S), 3). Hence there 
exist finite sets of generators Ai^h, Ai^h and Aiyn for the final segments 

u^> u n 

a a DC A a^D 

finite 

of ^F(S), respectively. These sets have the required properties. □ 

The previous proposition applies to S = N™, by Corollary 14. 31 

A proposition of Haiman and Sturmfels. Next we show how a combinatorial 
statement due to Haiman and Sturmfels ([5], Proposition 3.2) can be obtained 
using the techniques above. This statement is crucial in the construction of the 
multigraded Hilbert scheme given in If S" is strongly Noetherian, then, given 
any function h: A — > Noo, there are only finitely many admissible final segments 
with Hilbert function h. Moreover: 
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Lemma 6.2. Suppose S is strongly Noetherian. Then, for any function h: A — » 
Noo, there exists a finite set D C. A such that every F G ^F(S) satisfies: if Tip (a) 
/i(o) /or all a £ D, then hp(a) *S h{a) for all a S A. 

Proof. Let /i: A — > Noo, and let .M^h = {Fi, . . . , F m } be as in Proposition 16.11 
For each i there exists ai G A such that hp i (ai) > h(a.i). Let D = {a\, . . . ,a m }, 
a finite set of degrees. Now suppose F € ■F(S') satisfies hp\D ^ h\D. Then 
F ^ T: Otherwise, F C Fj for some i, so hp(a) ^ for all a G A; but 

h'Fi(O'i) > hp^a.i): a contradiction. Thus hp (a) /i(a) for all a. □ 

Remark. In an analogous way, one shows: there exists a finite set D Q A such 
that for every F G •F(S'), if hp(a) < h(a) for all a £ D, then hp{a) < h(a) for all 
o£ A In particular, there exists a finite set F/ a C A such that for any F £ J-(S), 
if /if (a) < oo for all a € D a , then F is admissible. 

Note that the inequality hp(a) ^ /i(a) is clearly not determined by finitely many 
degrees a. (Consider S = N equipped with the grading S(m) — m, and h(a) = 1 
for all a.) However, we have: 

Lemma 6.3. Suppose that S is strongly Noetherian. For any function h: A — ► N, 
there exists a finite set DC A such that for every final segment F C S generated 
in degrees D: if hp (a) — h(a) for all a G D, then hp(a) — h(a) for all a G A. 

Proof. By induction on i, we construct an increasing sequence (-Di)i^o of finite 
subsets of A such that [Cj+i] C [d] for all i, where Cj denotes the finite antichain 
consisting of all F G ^"(S 1 ) which are generated in Di and whose Hilbert function 
agrees with h on Di. Let C = {F : /ip = /i}, a finite antichain, and let Dq be a 
finite set of degrees such that every F G C is generated in D - Inductively, suppose 
that Di has been constructed already. Let D i+ \ D be a finite set of degrees 
such that every F G Cj with = is in C; + i. We have [Cj+i] C [Cj]: if 

F G Ci+i, then the final segment G generated by the elements of F with degrees 
in Di is in Cj, and F C G. By Proposition 13.11 Cj+i = Cj for some i; D = Di 
works. □ 

From now on we restrict to the special case S = N", n > 0. Identifying monomial 
ideals in the polynomial ring R[X] = R[X\, . . . , X n ] (where R is a fixed commuta- 
tive ring) with final segments of N n as usual, we obtain the following strengthening 
of Proposition 3.2 in [H]. In that paper, A is an abelian group and 8 = deg: N™ — > A 
a semigroup homomorphism. (So a monomial ideal J of R[X] is admissible exactly 
if hi(0) < oo.) 

Corollary 6.4. Given any function h: A — > N, i/iere exists a finite set D C A such 
that 

(1) every monomial ideal with Hilbert function h is generated by monomials of 
degree belonging to D, and 

(2) if I is a monomial ideal such that hi (a) = h(a) for all a G D, then hi(a) = 
h(a) for all a G A. □ 

Noetherianity of the set of Hilbert functions. Let X = {Xi, Xj, . . . } be a 
countably infinite set of indeterminates. For n 1 we write X^ — {X\, . . . , X n }°, 
a subset of X°. We identify the set X^ n \ ordered by divisibility ^, with the set 
N™, ordered by the product ordering, in the usual way (see Section El . In our 
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last application, we will be concerned with the grading of X^ by A = N given 
by 8{X V ) = U\ + • • • + v n for v = (yt,..., v n ) E N n . (This corresponds to the 
usual grading of monomials in a polynomial ring.) For n ^ 1 let TL n be the set 
of all functions h: N — > N which arise as a Hilbert function h = Hf for some 
F S ^("U), and put H := U n>1 W„. We consider ft as an ordered set via the 
product ordering: h ^ h! if and only if h[a) ^ /i'(a) for all a E N. We then have: 

Proposition 6.5. H is Nash-Williams. 

This proposition generalizes Corollary 3.4 in [Q: 

Corollary 6.6. TL n is Noetherian, for every n ^ 1. □ 

The applications above (e.g., Proposition lfi.ljl just needed Maclagan's finiteness 
principle, i.e., N n is strongly Noetherian. Proposition 16.51 is a consequence of a 
deeper result of Nash- Williams' theory, of which we only state the special case 
needed here. 

Theorem 6.7. (Nash- Williams, j2E]) If (S, ^) is a Nash- Williams ordered set, then 
(S ,0 «s Nash- Williams. 

We totally order X by ^ so that Xi -< X^ < ■■ ■ . By the previous theorem, 
(F(JT°, ^<°), 3) is Noetherian. We denote the restriction of the ordering <° on X° 
to X^ also by We have 

The monomial ideals F € ^"(X'™', are commonly called strongly stable. It is 
a well-known consequence of a theorem of Galligo (see, e.g., [Hj, Section 15.9) that 
given a final segment F of (Jf>"\ ^) there exists a strongly stable final segment of 
(X<™>, s^) with the same Hilbert function /i F . If F 6 f(lW, ^) and F' denotes 
the final segment of ^) generated by F, then hp ^ /i F /, since hF'(m) — 

Y^iLo hp(i) for all m. We can now prove Proposition 16. 51 

Proof (Proposition . Let /: B — > be an 7i-array, say /(6) = ft.F b with F& G 
F(X<"^, <), n b > 1 for all 6. We need to find 6 < c such that h Fb sC fc Fc . After 
passing to a subarray of / if necessary, we may assume that rib ^ n c for all b < c 
in F. (By Lemma 15.71 ) By the remarks above, we may further assume that each 
F b is strongly stable, that is, F b G F(X^ , <°) for all b. By Theorem^ there 
exist b < c such that (F b ) D (F c ) in F(X°,^°), where (F fc ) and (F c ) denote 
the final segments of (X ,^ ) generated by F& and F c , respectively. Now F h ' := 
(F 6 ) n X^ is the final segment of (X< n "\ X*) generated by F 6 . We have F b ' D F c , 
in ^(X 1 *"^, ^°), hence hF b ^ ftf ^5 hp c as required. □ 

Part 2. Multi-stage Stochastic Integer Programming 

7. Preliminaries: Test Sets 

For a given matrix A G Z /Xd , where d, / G N, rf, 2 > 0, consider the family of 
optimization problems 

(IP 6 , C ) min{c T z : Az = b, z G N d } 

as b G and c E M. d vary. We call ^4 the coefficient matrix of this family (or 
of a particular instance of it). One way to solve such a problem for given c and 
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b is to start with a feasible solution z (i.e., a vector z G N d such that Az = b) 
and to replace it by another feasible solution z — v with smaller objective value 
c 1 (z — v) G R, as long as we find such a vector v G Z d that improves the current 
feasible solution z. Such a vector w is called an improving vector for z. If the 



problem instance I IPb iC I is solvable, this augmentation process has to stop (with 



an optimal solution)^ Note that for given b and c and any feasible solution z of 



(IPb !C l, a vector v G Z d is an improving vector for z if and only if the following 
three conditions are satisfied: 

(1) Av = 0, 

(2) v ^ z (in the product ordering on Z d ), and 

(3) c^v > 0. 

The key step in this scheme is to find such an improving vector v. Test sets provide 
such vectors: a subset of Z d is called a universal test set for the above problem 
family if it contains, for any given choice of c G M. d and b G M. , an improving vector 
for any non-optimal feasible solution z to the given specific problem. Clearly, if 
we have a finite universal test set, we can easily find an improving vector in the 
augmentation procedure. 

The notion of a universal test set was introduced by Graver [7] in 1975. He also 
gave a simple construction of a finite universal test set. The Graver basis G(A) 
associated to A consists of all IZ-mmimal non-zero integer solutions to Az — 0. Here 
C is the ordering of Z d defined in Section (Note that is the only C-minimal 
solution to Az = 0.) As we have seen above, G(A) is always finite. (Corollary 
Moreover, G(A) is symmetric: if v G G(A) then also — v G G(A). Graver showed 
that G(A) is indeed a universal test set for the above problem family. This leads 
to the following algorithm to compute, uniform in b and c, an optimal solution to 
(IPf, c I from a feasible one: 



Algorithm 7.1. (Augmentation algorithm) 



Input: a feasible solution z to (IPh. c I and a finite set GCZ containing G{A). 



Output: an optimal solution to (IP 



while there is some v G G such that c J v > and v ^ z do 

z := z — v 
return z 



How does one find some feasible solution to I IP&. C I to begin with? Universal test 
sets can also be employed to find an initial feasible solution by a construction similar 
to Phase I in the simplex method for linear optimization. 

Notations. For a G Z we put 

a + := maxjfl. 0} G N, a~ := max{-a, 0} G N, 

and for z — (z\, . . . , Zd) G Z d , we put 

z + := (zt, . . . ,4) € N d , z~ := (zf, ...,zj)e N d , 

so z = z + — z~ . We also let c(z) denote the vector in 1 d whose i-th component is 
— 1 if Zi > and otherwise. 

Slightly modifying Algorithm 17 . II yields the following algorithm (for whose ter- 
mination and correctness see [Tull5]1: 
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Algorithm 7.2. (Finding a feasible solution) 

Input: a solution z € Z d to (If\ c I and a finite set G C Z d containing G(A). 



Output: a feasible solution to |IP;, iC l, or "FAIL" if no such solution exists. 



while there is some v G G such that c(z) T v > and v ^ z + do 

z := 2 — u 

if z ^ then return z else return "FAIL" 

Graver proved finiteness of G(A); however, he did not give an algorithm to compute 
G(A) from A. The following simple completion procedure, due to Pottier solves 
this problem. We write ker(^4) := {z G Z d : Az = 0} (a Z-submodule of Z d ). 

Algorithm 7.3. (Completion procedure) 

Input: a finite symmetric generating set for the Z-module ker(A). 

Output: a finite subset G of Z d containing G(A). 

G:=F\{0} 

(■■■ {/ ' //:/•// • G) 
while C 4 do 

s := an element in C 

G:=G\{ S } 

/ := normalForm(s, G) 

if / ^ then 

C:=CU{f + g:geG} 

G:=GU{/} 

return G. 

Behind the function normalForm(s, G) there is the following algorithm, which upon 
input of a finite set G — {gi, . . . , g n } of non-zero vectors in Z d , returns a vector / 
with the property that s has a representation as a finite sum 

(7.1) s = f + aiSi with o, G N, <7, G G, □ s and gi % f for all i. 

i 

The vector / is called a normal form of s with respect to the set G. The algorithm 
proceeds by successively reducing s by elements of G: 

Algorithm 7.4. (Normal form algorithm) 

Input: a vector s G Z d , a finite set G of non-zero vectors in Z d . 
Output: a normal form / of s with respect to G. 
while there is some g G G such that g C s do 

s := s - g 
return / := s 

As || s — g ||i < || s ||i for ^ g C s in Z d , the algorithm always terminates. Here 

ll s lli = l s i| H 1" M f° r s = ■ ■ ■ , Sd) G Z d . 

In the subsequent sections we will generalize the main ingredients of this com- 
pletion procedure. The objects in our algorithm, however, will turn out to be more 
complicated structures than mere vectors. We finish this section with a useful fact 
needed in the next section. 

Lemma 7.5. Let d,e,l > be integers, A G Z lxd , B G Z (xe , y G Z d , z G Z e , 
and b := —Bz. If (y, z) G G(A\B), then either z — and y G G(A), or z ^ and 
(y,l)eG(A|-&). 
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Proof. Suppose that (y,z) G G(A\B); then (y, 1) G ker(A|-6). If z = 0, then 
clearly y G G(A), so we may assume z ^ 0. Let u G Z d , ueZ with Au = vb and 
C (y, 1). Then either w = or (j = 1. If u = 1, then Am = b = —Bz, so 
(w, z) G ker(A|B) and ^ (u,z) C (y, z), which yields u = y by (y, z) G G(A|_B), 
hence (it, u) = (y, 1). If u = then Au = 0, so (y — u, z) G ker(A|_B) and 7^ 
(y — u, z) Q (y, z), which yields u = by (y, z) G G(A|£?), hence (u,v) = (0,0). 
This shows that (y, 1) G G(A\-b). □ 



8. Building Blocks 

In this section we study multistage stochastic integer programs. We begin by de- 
scribing the basic setup, and then use results from the previous sections (in par- 
ticular Corollary 15 . 1 Of) to show that the Graver basis elements of the coefficient 
matrices of stochastic integer programs of this type can be constructed from only 
finitely many "building blocks," as the number N ^ 1 of scenarios varies. 



Basic setup. In the following we fix integers k ^ and / ^ 1. Let To, Ti, . . . , T& 
be a sequence of integer matrices with each T s having I rows and n s columns, where 
n s G N, n s ^ 1 for s = 0, . . . , k. We set Aq,n := (To), and we recursively define for 
s = 1 , . . . , k 



( T^s.N 



A s -l t jy 






A S -1,N 



A. 



s-l,N 



where T s jf = 



consists of N s 1 many copies of the matrix T s 



Example. For k = 2 and TV = 2 we have A , 2 = (To), A la = (t\ T ° t 

( T 2 T x T \ 

A 2 , = I5 T ' T » 



T 2 
\T2 



Ti T 
Ti To, 



and 



As discussed in the introduction, matrices having the form of A^n arise as the 
coefficient matrices of (k + l)-stage stochastic integer programs. 

Remarks. Note that we assume here that the scenario tree of our stochastic opti- 
mization problem splits into exactly N subtrees at every stage. This simplifying 
condition can easily be achieved by introducing additional scenarios with vanishing 
conditional probabilities. Also note that the coefficient matrix A^jv for a two-stage 
stochastic integer program with N scenarios differs somewhat from the general form 
of a coefficient matrix given in the introduction: in the description of a two-stage 
stochastic program 

min |c T a; + ■ {d 1 yi) : Ax = a, Wy % = h t -Tx, x G N m , y 4 G N™ j 
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as in the introduction, we read the constraints Ax — a as Ax + Oy, = a, and in 
doing so, we may rewrite the problem matrix as 

/ V w \ 
\r w j 

with T' = (-) and W = Thus, we can safely avoid stating the constraints 

Ax = a explicitly. The same holds true in the multi-stage situation, as we can 
apply a similar reformulation of the problem. 

For s = 0, . . . , k, the matrix A Si n has N s ■ I rows and 

s 

d s ,N =n s + Nd s -i tN = n s + Nn s ^ + N 2 d s ^ 2 .N = ■ ■ ■ = ^ N^rn 

i=0 

columns. In particular, the full (k + l)-stage problem matrix Ak,N has 

k 

d k ,N =Y J Nk ~ j ' n i 
i=0 

columns, which corresponds to the number of variables of the corresponding sto- 
chastic integer problem. In the following h and s range over the set {0, . . . , k}. We 
also put 

n(h) := no H h n h (= d hA ). 



Building blocks. Let N ^ 1 and [1, N] := {1,2,..., N}. For s = 0, . . . , k we fix 
an enumeration of the set [1, N] s of sequences of elements from [1, N] of length s, 
say in lexicographic order. By convention [1, N]° — {e} where e = ( ) denotes the 
empty sequence. We write 

z = (z a : a e [1, N] s , s = 0,...,h) 

to denote a vector z consisting of the 1 + N + N 2 + ■ ■ ■ + N h many integer vector 
entries z a G U lh - s , where a £ [1, N] s are indexed according to the enumeration of 
[1, N] s . For s = 0, . . . , h and a £ [1, N] s , we call z a a building block of height s 
of z. We have z £ ker^^AO if and only if for all a = (ai, . . . , ah) £ [1, N] h 

h 

ThZ a \o + T h -\z a \i H h T z a \ h = ^2 = 0, 

i=0 

where a\i :— (a\, . . . , Qj) for i = 0, . . . , h. (Here again Z° = {e}, so a\0 = e for all 
a £ Z h .) This relation can also be written as 

/ z a\0 \ 



\ Z a \h J 
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Vector-trees. It is useful to visualize a vector z 6 *Z dh - N as a (directed, labeled, 
unordered) tree of height h whose nodes are labeled by its building blocks z a , and 
there is an edge from the node labeled by z a to the node labeled by zp exactly if a 
is an initial segment of /?, that is, a = (3\s for some s = 0, . . . , h. (See Figure^) We 
call this tree the vector-tree T(z) associated to z. Such a vector-tree associated 
to an element of Z dh JV is a full iV-ary tree (i.e., every internal node has exactly N 
children). In the following we will consider trees of a similar structure which may 
split into possibly infinitely many sub-trees at each stage: 

Definition 8.1. A vector-tree of height ft, is a (non-empty, countable, directed, 
labeled) tree which is balanced of height h (i.e., every path from the root to a 
leaf has the same length h) and whose nodes of height s are labeled by integer 
vectors in Z nh - S , for s = 0, . . . , h. (Sometimes we also call the labels of a vector- 
tree its building blocks.) We denote the label of the root of a vector-tree T by 
root(T) e Z nh . 




777777777 

(1,1) (1,2) (1,3) (2,1) (2,2) (2,3) (3,1) (3,2) (3,3) 



Figure 1: Representing multi-stage solutions as trees 

We have an obvious notion of isomorphism of vector-trees (as an isomorphism 
of directed graphs which preserves the labeling). In the following we identify iso- 
morphic vector-trees; this permits us to speak of "the set of all vector-trees" . For 
every full iV-ary vector-tree T of height h there exists an element z of 1 dh - N whose 
associated vector-tree is T; we have root(T(z)) = z e . 

Definition 8.2. If S and T are vector-trees (of possibly different heights), we say 
that <S is a sub- vector-tree of T if 

(1) S is a labeled subtree of T, that is, the underlying graph of S is a subgraph 
of the underlying graph of T, and the labeling of the nodes of S agrees with 
their corresponding labeling in T; 

(2) S is closed downwards in T, that is, if there is a path in T from the root 
of S to a node a in T, then a is a node of S. 
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If S is a sub- vector-tree of T where S has h — 1 and T has height h, then S is called 
an immediate sub- vector-tree of T. 

Example. In Figure ^ the labeled subtree consisting of the nodes labeled by zm, 
£(1,1)' z (i,2); z (i.3) i s a sub- vector-tree of the vector-tree associated to z, whereas 
the labeled subtree consisting of the nodes labeled by z s , zn\, z (i,2) is not. 

Paths in vector-trees. Every path in a vector-tree T of height h from its root 
to one of it leaves is called a maximal path. Every maximal path in a vector 
tree of height h has length h. If vq, V\, . . . , Vh are the successive labels of the nodes 
on a path P in T we also say that P is labeled by (vq, . . . ,Vh), and we call 
(v , ...,«/.) G Z n W the label of P. We write paths(T) for the set of labels of 
maximal paths in T. 

Definition 8.3. We say that a vector-tree T of height h has value b G Z l if for 

every (vq, Vx, . . . , Ufc) G paths(T) we have 

T/jVo + Th^vi H h T v h = b. 

Note that if T is a vector-tree of height h > and value 6, then each immediate 
sub- vector-tree of T has value b—Th root(T). An element z of Z dh JV lies in ker(A^ ; jv) 
if and only if T{z) has value 0. 

Definition 8.4. Let T be a vector-tree of height /i and iV a positive integer. A 
vector z G Z dh JV with the property that paths (^~(z)) C paths(T) is said to be 
constructible from T. We denote by (T)m the set of vectors in Z dh - N which are 
constructible from T. 

Remarks. We have (7~)i = paths(T). If T has value b, then for every z G (1~}n, 
the vector-tree T(z) has value 6. 

We say that a vector-tree T is tight if the labels of the children of internal nodes 
of T are pairwise distinct. For example, the vector-tree 








2 



is tight, whereas 








2 



is not. The following is easy to show: 

Lemma 8.5. Let S be a non-empty subset of Z™*^ with z e = r for all z G S . 
There exists a unique tight vector-tree T(S) of height h (up to isomorphism) with 
S = paths (T{S)) . 

In particular, for every vector-tree S of height h there exists a unique tight vector- 
tree T of the same height with paths(T) = paths(5), namely T = T(paths(5)). 
Note also that in the context of the previous lemma, if S C ker(^4^ j i), then T(S) 
has value 0. 
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Reducibility of vector-trees. Next, we define a "reducibility relation" between 
vector-trees of the same height. This relation bears a formal resemblance to Milner's 
"simulation quasi-ordering" for transition systems |23| . 

Definition 8.6. Let S and T be vector-trees of height ft. 

(1) For ft = we let S C Q T if root (5) C root (7*) (in Z™°). 

(2) For ft, > we let S Q h T if root (5) C root(T) (in Z" h ) and for every 
immediate sub- vector-tree T' of T there is an immediate sub-vector-tree S' 
of 5 such that S' T'. 

There is an obvious algorithm to decide, given finite vector-trees S and T of 
height ft, whether S C/j T. Clearly is a quasi-ordering on the set of vector-trees 
of height ft. In the proof of the next lemma we relate with the quasi-ordering 
\=h on 7\(Z n w) defined after Theorem 15. 91 we freely use the notations introduced 
there. 

Lemma 8.7. The quasi- ordering on the set of vector-trees of height ft is Noe- 
therian. 

Proof. First we put 

7> *(Z n ) := Z n , P£(Z") := ^(^(Z")) \ {0} for ft > 0. 

So P^(Z") is a subset of ^(Z"), for each ft and n > 0. By induction on ft, = 0, . . . , k 
we now define for all m, n G N, m, n > 0, an operation 

h-> « * h X: Z m x P£(Z n ) TZ(Z m+n ) 

as follows. For ft = we have V* h (fl n ) = Z"; we let v * w G Z m +™ be the 
concatenation of w G Z™ 1 and w G Z" . For ft > we let 

v * fc X := {v X' : X' G X} for all i> G Z m , X G 7^(Z"). 

Note that for v,w G Z m and X, Y~ G 7^(Z n ) we have: if v * h X C h w * h Y in 
P t (Z m + n ), then oCtoandlCJ (in V h (Z n )). 

Next, we define a map ^ which associates to every vector-tree S of height ft an 
element tp h (S) of P*(Z n W) as follows: For ft = put <p (S) := root(S) G Z n °. For 
ft > let 

<Ph(S) := {root(S) */, iph-i(S') : S' sub-vector-tree of S of height ft — l}. 

By induction on ft it is easy to verify that iph is a quasi-embedding of the set of 
vector-trees of height ft, quasi-ordered by Qu as defined above, into V^(Z n ^\ 
quasi-ordered by the restriction of the quasi-ordering \—h of 7^(Z n W) defined after 
Theorem l5.9l The lemma now follows from Corollary 15. 1UI □ 

Corollary 8.8. There is no infinite sequence 71,72, • ■■ of vector-trees of height ft 
with % j2h Tj whenever i < j. □ 

Given vector-trees S and T of height ft and an integer AT ^ 1 we write 5 Qh,N 7~ 
if for every z G (T)tv there exists y G (5) at such that y C z (in Z dh - N ). We put 
5 Eh.oo T if 5 Q h>N 7" for all N ^ 1. 

Lemma 8.9. 7/5 C/, T, iften £ Eh,oo 7". 
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Proof. Suppose that S C/j T, and let N ^ 1. By induction on h = 0, . . . , k we 
show that given z 6 (7~}at we can construct a vector y E (S) n such that y C z. 
Suppose first that /i = 0. Then 2 = root(T), and root(iS) C root(T). Hence for y 
we may take y = root(5). Now assume that h > 0, and let z\, . . . , zm E 7L dh - x - N 
such that T(zi), . . . , T(zat) are the immediate sub-vector-trees of T(z). Then for 
each i = 1,...,N there is an immediate sub- vector-tree % of T with z; E {%)n- 
Since <S T we have root(5) C root(T), and for every i there exists a sub-vector- 
tree Si of S of height h — 1 with 5^ C^-i 7$. By induction hypothesis there exist 
yi,---,VN E at such that yi C z 4 in . Then |/Cz for a suitable y £ 7L dh - N 

whose vector-tree T(y) has immediate sub-vector-trees T(yi), . . . ,T(y^) and root 
labeled by root(S). □ 

Lemmas 18.71 and 18.91 imply: 

Corollary 8.10. For every h, the quasi- ordering C/j )00 on the set of vector-trees 
of height h is Noetherian. □ 

Building blocks of Graver bases. Recall that G(Ak.N) denotes the Graver basis 
of the matrix A k ^ (a finite subset of Z dfc JV ). We decompose each vector z E 
G(Afe jv) mto its building blocks z a as described above and put 



H k>N := {z a :ze G(A k , N ), a E [1, N] s ) C for s = 0, . . . , k. 

We form the union 7i k ^ := Uiv=i ^fc n an< ^ define 



the set of building blocks of Graver bases of the matrices A k ^ obtained by varying 
N over the set of positive integers. For fc = we have 7io,oo = G(Tq) and thus, 
Tio.oo is finite. Finiteness of TL\ y00 was shown in |12j . In what follows, we prove: 

Proposition 8.11. The set Hk,oo is finite for every fc. 

Before we give the proof of this proposition, we establish a few auxiliary facts. 
We first combine the elements of 7ife j00 into (a priori possibly infinite) vector-trees: 
Given r E H° koo , we put T{r) := T(S(r)) where 

S(r) := (J { paths (T(z)) : z E G(A k>N ) for some N > 1, z e = r} C Z n ^. 

The vector-tree T(r) of height fc has root r and value 0. For any r E W£ and 
any N ^ 1 the set (T(r))jv contains every vector z E G^-Aj^jv) with z e = r. In 
particular G(A fejA r) n (T(r)) N ^ for some N > 1. This yields: 

Corollary 8.12. TTie vector-trees T(r), where r ranges over all non-zero elements 
ofH k ool form a Q ki00 -antichain. 

Proof. For a contradiction suppose that T(r') Qk,oo T(r) for some non-zero r' ^ r 
in . So for every N ^ 1 and every z E (T(r))jv there exists a vector y E 
(T(r'))jv such that y C z. Note that y £ = root (T(r')) ^ root (T(r)) = z e , hence 
i/.z / and y ^ z. Therefore, none of the vectors constructible from T(r) is 
an element of a Graver basis G(A k ,N), for any N. This contradicts the remark 
preceding the corollary. □ 




(disjoint union), 
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By Corollaries 18 . 1 01 and 18.121 the set H k ^ is finite. We can now prove Proposi- 
tion Em 



Proof fProposition lS. 1 1[) . We show, by induction on k, that Hk,oo is finite, for 
every choice of matrices To, ... ,2*. as in the beginning of this section. We already 
know that Ho,oo — G(To) is finite. Suppose k > 0. We have seen above that x 
is finite. Hence it suffices to show that for each r G Tt k x , the vector-tree T(r) is 
finite. 

Suppose first that r — 0. By induction hypothesis, Tlk-i.oa is finite. Hence it 
is enough to show that all labels of non-root nodes of T(0) are in Hk-i,oo- Let v 
be the label of a node of height s > of T(0). There exists an integer N ^ 1, 
a vector z G G(vlfc,.zv), and a = (ai,...,a s ) £ [1,^V] S such that z e = and 
z Q = v. Let z' € Z dfe - 1JV such that T(z') is a sub-vector-tree of T(z) and z^/ = v, 
where a' = (a 2 , ■ ■ ■ , a s ) (i.e., T(z') contains our node labeled by v). Then clearly 
z' £ G(A fc _ 1 j V ) and thus v £ ^ as desired. 

Now suppose r^O. Let T' k _ x be the Z x (1 + nfc-jj-matrix (— Tfer|Tfe_i) and put 
T' g := T s for s = 0, . . . , k — 2. Define A' s N in the same way as A s ^ at the beginning 
of this section, with the matrices T' s replacing T s . Let TC' k _ 1 x be the set of building 
blocks of Graver bases of A' k _ 1 N , for N ^ 1. By induction hypothesis, Tt' k _ 1 x is 
finite, so it is enough to show that for every node of height s > of T(r) with label 
v, we have v £ 'H' k _ 1 oa . Let N ^ 1, z £ G{Ak^), and a — [a\, . . . , a s ) € [1, N] s 
with z e — r and z a — v. Let z' £ Z, dk - 1 < N such that T(z') is a sub-vector-tree of 
T{z) with z^, = v, where a' = (a 2 , . . . , a s ). Then (r, z') G G{T ktN \A k ^i^ N ). By 
Lemma r7.5l z' is a projection of an element of G(A' k _ 1 N ). Therefore the building 
blocks of z' are in Ti.' k _ 1 . In particular v £ Ti.' k _ 1 as required. □ 

The proof of the proposition above suggests a procedure for constructing Tlk,oo 
for k = 0,1,2,... inductively. In the next section we describe such an algorithm. 
We finish this section by a few remarks about the choice of the reducibility relation 
C fc . First note the following immediate consequence of the fact that paths(T) = 
(T)i for every vector-tree T: 

Lemma 8.13. For vector-trees S, T of height h we have: if S E/ lj00 T, then for 
every w £ paths (T) there exists v £ paths (S) such that v C w 

The converses of the implications in Lemmas 18.91 and 18.131 are false in general, 
as the following two simple examples show. In particular, this (at least partly) 
explains why in the algorithm for computing TLk.oo in the next section, we cannot 
simply replace C fc by the quasi-ordering ^ on vector-trees of height k given by 



whose Noetherianity is much easier to show than the Noetherianity of the quasi- 
ordering \—k (cf. Corollary 14.31 in the case n = n(k)). In both examples k = 2 and 
no = ni = i%2 = 2. 



(8.1) 




for every w £ paths(T) there is v £ paths(iS) 
such that v □ w, 
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Example. The vector-trees 

(0,0) (0,0) 



(0,0) (0,0) (0,0) 

I I /\ 

(0,1) (1,0) (0,1) (1,0) 

s r 

show that we may have S C 2;00 T and S %2 T. 

Example. Consider the vector-trees 

(0,0) (0,0) 



(0,0) (0,1) (0,1) 

(1,0) (0,1) (1,0) (0,1) 

S T 

We have S T (as defined in iJOJ)- Suppose that z £ Z 14 has associated vector- 
tree 

(0,0) 

/ \ 
(0,1) (0,1) 



(1,0) (0,1) (1,0) (0,1) 

Then z S {T)2, but there is no y £ (5)2 with j/Cz. 

9. Computation of Building Blocks 

Our algorithm for computing a finite set of vector containing TLk,oo follows the pat- 
tern of a completion procedure, similar to Buchberger's algorithm for computing 
Grobner bases of ideals in polynomial rings over fields. Instead of with (finite sets 
of) polynomials, our procedure operates with finite vector-trees. Before we describe 
our algorithm, we need to specify some crucial ingredients for this completion pro- 
cedure, among them the input set and a notion of normal form. The notations and 
conventions adapted in the last section remain in force until the end of the paper. 

Adding and subtracting vector trees. We begin by defining operations which 
allow us to construct new vector-trees from old ones. For this we use the following 
notations, for subsets V and W of Z m , m > 1: 



-V 



= {-v : v £ V}, 



V + W := {v + w : v G V, we W}, 

V — W := {v — w : v € V, w £ W, v}. 

Note that in general V — W ^ V + (— W). In the following S and T range over the 
set of vector-trees of height k. 
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Definition 9.1. We put 

-S := T (- paths(S)) , S + T := T ( paths(S) + paths(T)) . 

If T Efe S, then paths(5) — paths(T) ^ by Lemmas 18 . 91 and 18.131 and in this case 
we put 

S - T := T(paths(5) - paths(T)). 

Remarks. 

(1) We have paths(— S) = — paths(c>) and paths(6>+T) = paths(5)+paths(T). 
If T C fc S then paths(S - T) = paths(S) - paths(T). 

(2) If S has value a € Z l and T has value i) £ Z 1 , then —S has value —a, S + T 
has value a + &, and if in addition T C fc 5, then S — T has value a — b. 

(3) There are obvious algorithms to compute, given finite S and T, the vector- 
trees — <S>, 5 + T, and S — T (provided T Cfc 5). 

Normal forms. We say that S* is a normal form of S with respect to a set G 
of vector-trees of height k if 

(1) T g fc 5* for all T e G with root(T) ^ 0, 

(2) there exists a sequence iSo,...,5 n of vector-trees of height k such that 
iSo = 5, S n = S* , and for every j = 0, . . . , n — 1 there exists % G G with 
7^ C fe Si and = S l -%. 

Note that for fc = 0, if we identify each vector-tree of height with the label of 
its root, this notion corresponds to the notion of normal form for elements of Z™° 
introduced in Section [7| The following algorithm computes a normal form: 

Algorithm 9.2. (Normal form algorithm) 

Input: a finite vector-tree S of height k and a finite set G of finite vector-trees 
of height k. 

Output: a normal form normalForm(5, G) of S with respect to G. 
while there is some T G G such that T S and root(T) ^ do 

5 :=5-T 
return S 

The algorithm above terminates: if T 5, then root(<S— T) = root (5)— root (T) C 
root(5), hence if in addition root(T) ^ 0, then ||root(c> — T)\\i < \\ root(<S)||i. 
Note that if every vector-tree in G has value 0, and S has value a, then the 
output normalForm(iS, G) also has value a. Algorithm 19.21 will be employed as 
a sub-program in our algorithm for computing the set TLk,oo- In the proof of the 
correctness of the latter we will use the following crucial lemma and its corollary 
below. 

Lemma 9.3. Let N > 1. 

(1) If ' y £ (S)n and z £ (T)n, then y + z G (S + T)n . 

(2) If T \—k S and y G (S)n, then there exists z G (T)n such that z C y and 
y - z G (S - T) N . 

Proof. For part (1), suppose that y G (S) n and z G (T)n, that is, paths (T(y)) C 
paths(S) and paths (T(z)) C paths(T). Then 

paths (T{y + z)) C paths (T(y)) + paths (T(2:)) 

C paths {S) + paths (T) = paths (S + T), 
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hence y + z £ (S + T)n as claimed. We show (2) by induction on k. The case 
k = being easy, suppose that k > and the claim holds with k — 1 in place 
of k. Since T C fc 5, we have root(T) C root(c>) = yo.e- Consider y' e J J dk - 1 - N 
whose vector-tree T(y') is an immediate sub- vector-tree of T(y). Then there exists 
a unique immediate sub- vector-tree S' of S with y' S (5') at. Since T iS we find 
an immediate sub-vector-tree T of T with T' Efc-i <S'. By inductive hypothesis 
there exists z' £ {1~'}n such that z' C y' and y' — z' G (5' — T')n- These remarks 
suffice to construct a vector z S 1 dk - N with the required properties. □ 

For a set G of vector-trees of height k and an integer N ^ 1 we put 

(G) N := (J (2V 
TeG 

Part (2) of the last lemma (which strengthens Lemma l8.9|) immediately implies: 

Corollary 9.4. Let G be a set of vector-trees of height k, and let S* be a normal 
form of S with respect to G. For all N ^ 1 and s £ (S)n there exist f £ (S*)n 
and gi, . . . , g n £ (G) n such that 

s = Z + y^ffi, gi E s /or a/Z i 

Choosing an input set. The following lemma justifies the choice of input set for 
Algorithm 19.81 below. 

Lemma 9.5. Suppose that k > 0, and let F be a set of generators for the 1- 
submodule K :— ker(A k ^i) of Z n ^ k ' which contains a set of generators for the sub- 
module 

K :=A'n({0}xZ" M ) 
of K . Then for every N ^ 1, the set 

F N :=({T(v):veF}) N 

generates ker(Afe j jv). 

A generating set F satisfying the hypothesis of the lemma can be found algo- 
rithmically by standard methods (e.g., Hermite normal form). In the proof of the 
lemma we use the following notations. 

Notations. Let N > 1, a =(a u ..., a k ) £ [l,N] k . For z £ Z d "- N we put 

v(z, a) := (z a \ , . . . , z a \ k ) £ paths (T(z)) , 

and for v = (v , . . . ,v k ) £ Z n ( k \ we denote by z(a,v) the vector z £ 7L dk - N which 
satisfies, for s = 0, . . . , k and [3 £ [\,N] S : 

\v s if f3 = a\s, 

z '■= i 

I otherwise. 

We also let z(v) be the unique element of Z dk - N whose vector-tree T = T{z{v)^ 
satisfies paths(T) = {v}. Clearly, for v £ Z n W and z £ Z dk - N : 

(9.1) z £ ker(A k}N ) =^> v(a, z) e ker(A kjl ), 

and 

v£ker(A k . 1 ) ^=^> z(a,v) £ ker(A k . N ) ^=^> z(v) £ ker(A ktN ). 
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Proof (Lemma 19 .51 . Let z G ker(A/s,Ar), where k,N 1. Fix an arbitrary a G 
[1, Af] fe and put i> = v (a, z); by l|9.1[l there are a\, . . . , a m G Z and v±, . . . , w m G -F" 
such that 

u = aivi H h a m v m . 

Then z(vi) G i*jv for each i, and 

(9.2) z(v) = aiz{vi) H h a m z(u m ). 

Now if /3 G [l,iV] , then v(z,fl) — v G i\ , hence for some a^i, . . . ,ap. mi3 G Z, 
V/3,i, ■ ■ ■ ,«/3,m^ G F n AT , m/3 G N: 

v(P, z) - v = 0/3,1^,1 H h a/3 !m0 vp, m p 

and therefore 

(9.3) z(/3, w(/3, z) - = a (3: iz(/3, ug,i) H h a^ m/3 z(/3, ua,™^) 

with z(f3,V/3j) G -F/v for each j. Combining 

* = z(«) + ^2 z (p> v ( z > &) - V ) 

p 

with (|9~2|l and yields an expression of z as a Z-linear combination of vectors 
in Fn, as required. □ 

Computing Tik.oo- We now specify an algorithm which recursively (in k) computes 
the set Hk,oo- The following completion procedure is at the heart of the A:-th step 
in the algorithm. We say that a set G of vector-trees of height k is root-complete 
if for all S, T G G the sum S + T has a normal form AT with respect to G such that 
root(W) = 0. 

Algorithm 9.6. (Completion procedure) 

Input: a finite set G of finite vector-trees of height k. 

Output: a finite set of finite vector-trees of height k which contains G and is 

root-complete. 
C :={S + T:S,T eG} 
while C ^ do 

S := an element in C 
C :=C\{S} 
T := normalForm(iS, G) 
if root(T) ^ then 

G:=GU{T,-T} 

C :=CU{S + T,S + (-T) : S G G} 

return G 

We turn to termination and correctness of Algorithm 19.61 

Proposition 9.7. Alaorithm \9.b\ terminates and satisfies its specification. 

Proof. Let Gi be the value of G and Si be the value of S in the i-th pass of 
the while -loop in Algorithm 19.61 and T. L := normalForm(iSi, Gi). Suppose that 
root(^) ^ for all i in an infinite subset I of N\{0}. Now T g k % for all T G G t 
with root(T) ^ 0, and % G Gj for all i < j. In particular % %t 7j f° r a U * < J ' m ^- 
This contradicts Corollary 18. 81 Hence there is some n such that root(7i) = for all 
i ^ n. So if m is the size of the set C before the n-th iteration of the while - loop, 
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then Algorithm 19.61 terminates after m more iterations. This shows termination of 
Algorithm 19. 61 Correctness is easily shown. □ 

We say that a set G of vector-trees of height k is symmetric if S £ G => —S £ G 
for all S. If G is symmetric, then for each N 1, the subset (G)at of 7L dk - N is also 
symmetric: z 6 (G)n —z £ (G)jv for every z £ Z dk - N . 

Remarks. 

(1) If the input set G in Algorithm 19. 61 is symmetric, then so is its output set. 
If every vector-tree in G has value 0, then so does every vector-tree in the 
output set. 

(2) For k = and input set G = a finite symmetric generating set for the 
Z- module ker(Xb)j Algorithm 19.61 reduces to Algorithm 17.31 from Section 
and computes a finite set of vectors containing G(Tq). 

Here now is: 

Algorithm 9.8. (Algorithm to compute Wfc j00 ) 
Input: an integer k ^ 0. 

Output: a finite symmetric set G& of finite vector-trees of height k such that 

G{A ktN ) C (Gfe)jv for all N > 1. 
for i = 0, . . . , k do 
if i = then 

Fq := a finite symmetric generating set for ker(Ao ; i) 
G := {T(u) : v £ F } 

else 

-Fi := a finite symmetric generating set for ker(Ai.i) satisfying 

the hypothesis of Lemma f9. 51 ffor k = i) 
% := T({(0,v) : v = or v G paths(S) for some S € G l - 1 }) 
G:={T }u{T(v):veFi} 
G L := output of Algorithm 19.61 applied to G 

Since termination of Algorithm 19.81 follows from Proposition 19.71 we only need 
to establish its correctness: 

Theorem 9.9. Let Gq, . . . ,Gk be the sets computed by Algorithm \9.tA for given 
input k. Then each Gi is a finite symmetric set of finite vector-trees of height i with 
G{Ai^) C (Gi)N for all N ^ 1. (In particular, the set consisting of the building 
blocks of vector-trees in Gfc contains 7ifc j00 .) 

In the proof we use the following immediate consequence of Lemma 19.31 (1) and 
Corollary El 

Lemma 9.10. Let G be a root-complete set of vector-trees of height k. Then for 
every N ^ 1 and y, z £ (G)n there exist f £ 1 dk - N and gi, ■ ■ . ,g n £ (G)n such that 
f e = and 

y + z = f + 9 E V + z for all j. 

3 

For the proof of Theorem 19.91 fix integers k ^ and N ^ 1. We show, by 
induction on i = 0, . . . , fc, that G(A it N) C (Gj)iv- The case i = is covered by 
Remark (2) following the proof of Proposition ^. 7l Suppose that i > 0. By inductive 
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hypothesis, is a finite symmetric set of finite vector-trees of height i — 1 with 

G(Ai-i t N) C (Gj_i)jv. In particular, 7o has value and — 7o = %. Moreover, by 
the next lemma, every / G ker(-Af jy) with f e =0 has normal form with respect to 
(To) at- In the proof we denote the concatenation of the finite sequences a G [1, N] s 
and /? G [1, Nf {s, t G {0, . . . , fe}) by a/3 G [1, iV] s+t . 

Lemma 9.11. For every f G ker^^jv) / £ = £/iere are hi, . . . , h m G (To)n 
such that 

f = ^ hj, hj E / /or a£7 j. 

i 

Proof. Let /„ G Z*- 1 ^, n = 1, . . . , N, be given by /„,„ := f {n)a for a G [l,iV] 8 , 
s = 0, — 1. Since / G ker^^jv) and f £ — 0, we have /i, • • • , /jv S ker(Ai_ijv). 
Hence for each n = 1, ... ,7V there are M(n) G N and g nm G G(yli_i i Ar), where 
m = 1, . . . , M(n), such that 



/n = ^2 9n,n 9nm E /n for all m. 



Now let h nm be the vector in Jj di < N defined as follows: for a = (cti, . . . , a s ) G [1, N] s , 
s = 0, . . . , i, let 

, J g nm ,a' if s > and ai = n 

I otherwise, 

where a' = (0:2, . . . , a s ). Then h nm can be constructed from Tq, since G(Ai-i^) E 
(Gi-i)N and G paths(7o), and / = J2 n m ^ nm with h nm □ / for all n and m. □ 

By Lemma 19.51 and the choice of Pi in Algorithm 19.81 (Gi)M is a symmetric 
generating set for ker^^jv). Hence {Gi)N can be used as an input set for the 
computation of a Graver basis for the matrix Ai,N fAlgorithm l7.3() . By Lemmas l9.10l 
and l9.1ll the sum y + z of two elements y and z of (G^at has normal form with 
respect to (G^at. Hence Algorithm 17.31 applied to A^jy and (G;)at just returns the 
input set {Gi)N] in particular G(Ai^) C {Gi)N as desired. □ 

Remarks. 

(1) Theorem 19.91 gives another proof of Proposition ^. Ill 

(2) For k = 1, the algorithm to compute Hk,oo described above differs slightly 
from the one given in |12|. This is because Algorithm 3.15 in is de- 
fective: to see this, consider (in the notation introduced there) the pairs 
s = g = (0, {0, 1}); then g C s and s g — s, causing Algorithm 3.15 to 
diverge on the inputs s and G = {g}. 

10. Finding an Optimal Solution 

In this final section we outline how the set Gk produced by Algorithm 19.81 can be 
employed to solve any particular instance 

(IPiVAc) min{c T z : A k . N z = 6, z G ~ } 

of our family of (k + l)-stage stochastic integer programs, given a choice of the 
number N of scenarios, a right-hand side b G Z efc,JV (where ek,N '■= N k ■ I = number 
of rows of the coefficient matrix ^4fc,iv), and a cost vector c G M. dk - N . Throughout we 
assume that a finite set Gk of finite vector-trees of height k such that G(Ak,N) Q 
(Gk)N for all N ^ 1 (as computed by Algorithm 19. 8fl is at our disposal. 
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We first concentrate on the problem of augmenting a feasible solution to an 
optimal one. For this we use the recursive algorithm below. We write a vector 
v G R dk - N (analogous to our practice in the case of integer vectors above) as 

v = (v a : a G [l,N] s , s = 0,...,k), 

and for k > and i = 1, . . . , N we put 

~ (%) a : a G [1, N] s , s = 0, . . . , k - l) G M. dk ~ 1 - N . 

Conversely, if k > 0, given r G M. nk and N vectors v\,...,vn G IR^- 1 '™, we 
denote by v(r, v±, . . . , vn) the vector v G M dfc JV with v e — r and v/^ = i>j for all 
i = 1, . . . ,N. With this notation, given T and iV ^ 1, the set (T)jv consists of all 
vectors z G Z dfc JV of the form z — v(ioot(T),Vi, . . . ,vn), where Vi G (75)jv for an 
immediate sub- vector-tree % of T, for each i = 1, . . . , N. 

Algorithm 10.1. (Algorithm to find most expensive constructible vector) 

Input: an integer N ^ 1, a finite set G of finite vector-trees of height k, a 

cost vector c G R dk > N , and a vector z G Z dfc - N . 
Output: a vector v = mostExpensive(A^, G, c, z) with v G (G) at and u ^ z such 
that c T w is maximal with these properties, or "FAIL" if no v G (G)at 
with i; ^ z exists. 
G':={TeG: root(T) < z e ) 
if G' = then return "FAIL" 
while G' ^ do 

T := the element of G' such that cj root(T) is maximal 
G' := G' \ {T} 

if k = then return root(T) 

Gt := the set of immediate sub- vector-trees of T 

for i = 1 to N do 

t>i := mostExpensive(iV, Gt, C(^), Z(i)) 
if Vi, . . . , vn 7^ "FAIL" then return t>( root(T), v\, . . . , vn) 
return "FAIL" 

Termination and correctness of the procedure above are easily seen. By the discus- 
sion in Section[3this implies termination and correctness of the following algorithm: 

Algorithm 10.2. (Augmentation algorithm) 

Input: an integer N ^ 1, vectors b G Z efc JV , c G R dfc . N , and a feasible solution 



z G N dk - N to (IP 



N,b.. 



Output: an optimal solution optimalSolution(A^, b, c, z) to (IP 



N.b.. 



while v := mostExpensive(Af, Gfe, c, z) ^ "FAIL" and c T w > do 

z := z — v 
return z 

The next algorithm produces an initial feasible solution from a given solution (in 
Z dk - N ) to the equation A^^z = b. Termination and correctness of this procedure 
follow from results in see also Algorithm 17.21 above . 

Algorithm 10.3. (Finding a feasible solution) 

Input: an integer N ^ 1, vectors b G Z Ck - N , c G M dfc - N , and a solution 
z G to ilP Nbl 
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Output: a feasible solution feasibleSolution(iV, b, c, z) to (IPjv.6,cI, or "FAIL" 

if no such solution exists. 
while v := mostExpensive (N, G/,, c(z), z + ) ^ "FAIL" and c(z) J v > do 

z := z — v 

if z ^ then return z else return "FAIL" 



Finally, this leads to our algorithm for solving instances of (IPjv,6, c I using G^: 
Algorithm 10.4. (Finding an optimal solution) 
Input: an integer N ^ 1 and vectors b £ lf k - N , c 6 



Output: an optimal solution to |IPjv,6,cIi or "FAIL" if no feasible solution 
exists. 

if there is no z £ r L dN - k with Ak,NZ = b then 
return "FAIL" 

else 

z := an element of Z djv fc satisfying Ak jyz = b 
f := fcasibleSolution(7V, 6, c, z) 
if / = "FAIL" then 

return "FAIL" 

else 

return optimalSolution(7V, b, c, f) 

Remark. The complexity of Algorithm 19 . 81 is unclear. For a very crude complexity 
result related to Maclagan's principle see £Q, Proposition 3.25. Some computational 
experiments in the case k = 1 are reported in ^2]) Section 4. Note that (once Gk 
is available) the running time of Algorithm lit). II above is 0(N k ). 
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